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Abstract 

In this paper, we discuss a new general formulation of fractional optimal 
control problems whose performance index is in the fractional integral form 
and the dynamics are given by a set of fractional differential equations in the 
Caputo sense. We use a new approach to prove necessary conditions of opti¬ 
mality in the form of Pontryagin maximum principle for fractional nonlinear 
optimal control problems. Moreover, a new method based on a generaliza¬ 
tion of the Mittag-Leffler function is used to solving this class of fractional 
optimal control problems. A simple example is provided to illustrate the 
effectiveness of our main result. 
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1. Introduction 

Fractional optimal control problems (FOCPs) can be regarded as a gen¬ 
eralization of classic optimal control problems for which the dynamics of the 
control system are described by fractional differential equations (FDEs) and 
5 might involve a performance index given by fractional integration operator. 
The reason to formulate and solve FOCPs relies in the fact that there are a 
significant number of instances in which FDEs describe the behavior of the 
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control systems of interest more accurately than the more common integer 
differential equations. This is the case, for instance, in diffusion processes, 
10 control processing, signal processing, stochastic systems, etc. [lj. 

Fractional calculus (FC) is a field of Mathematics that deals with in¬ 
tegrals and derivatives whose order may be an arbitrary real or complex 
number, thus generalizing the integer-order differentiation and integration. 
It started more than 300 years ago when the notation for differentiation of 
15 non-integer order 1/2 was discussed between Leibnitz and L’Hospital. Since 
then, fractional calculus has been developed gradually, being now a very ac¬ 
tive research area of Mathematical Analysis as attested by the vast number 
of publications (see 0,30,8). There are several different ways of defining 
fractional derivatives, and, consequently, different types of FOCPs. However, 
20 the ones in the sense the Riemann-Liouville and the Caputo have been more 
widely used. In most of the works that have been published on FOCPs, the 
state variable is obtained by the Riemann-Liouville or the Caputo fractional 
integration of the dynamics, but so far, only integer order integral perfor¬ 
mance indexes have been considered. It also should be noted that several 
25 specific numerical techniques have been developed to solve FOCPs. For more 
details, see 0,1,38- 

In this paper, we consider FOCPs for which the performance index is 
given by an integral of fractional order, and the dynamics are mappings 
specifying the Caputo fractional derivative of the state variable with respect 
30 to time. We use Caputo fractional derivatives because it is the most popular 
one among physicists and scientists. The reason for this is that fractional 
derivative of constants are zero. Moreover, the assumptions that we impose 
on the data of the problem enables a novel approach to the proof based on a 
generalization of Taylor’s expansions and a fractional mean value theorem. 
35 Another contribution of the paper consists on an analytic method to solve 
the fractional differential equation of the illustrative example based on a 
generalization of the Mittag-Leffler function and a exponential function. 

This paper is organized as follows. In the next Section, we present a 
brief review of fractional integrals and fractional derivatives concept and 
40 some basic notions specifically pertinent to this work. In Section [31 we state, 
discuss and prove necessary conditions of optimality in the form of a Pontrya- 
gin Maximum Principle for nonlinear fractional optimal control problems. In 
Section m a simple illustrative example of a FOCP solved by a method based 
on the Mittag-Leffler function is presented. Finally, in Section [ 5 ] we present 
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some conclusions of this research as well as some open challenges. 


2. Some preliminaries in fractional calculus 


There are several definitions of a fractional derivative. In this section, we 
present a review of some definitions and preliminary facts which are partic¬ 


ularly relevant for the results of this article [[10|, |]jj, |12( 


50 Definition 2.1. Let /(•) be a locally integrable function in interval [a, b\. For 
t E [a, b] and a > 0 , the left and right Riemann-Liouville fractional integrals 
are, respectively, defined by 


Jtfif) = : pT 7 - T [ (t — r) a 7(r)dr, 

r(a) Ja 

and 

jtm = 7 /V - t)°-'f( T )dT , 

r(«) J t 

where T(-) is the Euler gamma function. 

55 Definition 2.2. Let /(•) be an absolutely continuous function in the interval 
[a, b\. For t E [a, b] and a > 0 , the left and right Riemann-Liouville fractional 
derivatives are, respectively, defined by 


id 


sfW”'<‘» = 
(~j t r 


1 


r(n — a) 

1 

“ r(n- 



l f-t 

/ (t- rr- a -7(r)dr, 

J a 

d\ n r b 

Jt) 7-O—VWir. 


where n E N is such that n — 1 < a < n, and T(-) is as in Definition 2 . 1 . 

Definition 2.3. Let /(•) be an integrable continuous function in the [a, b\. 
so For t E [a, b] and a > 0 , the left and the right Caputo fractional derivatives 
are, respectively, defined by 
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r] n 1 f t 

c D ? m =. l (t - r)—/<*>«*, 

and 

» =* (-s)’^ = fj^) /(.-()—‘/‘"'Mdr, 

where n £ N is such that n — 1 < a < n. 

Remark 2.1. If a = n 6 No, then the Caputo and Riemann-Liouvillc 

d n fit) 

fractional derivative coincides the ordinary derivative —--. 

dt n 

65 Remark 2.2. The Caputo fractional derivative of a constant is always equal 
to zero. This is not the case with the Riemann-Liouvillc fractional derivative. 


Theorem 2.1 (see 13]). Let a > 0 and /(•) be a differentiable function in 
[a, b], then 


fAvr/m = m, py.y/w = /(«), 

aD“Xf(t) = fit), ,DZXf(t) = f(t), 

J^Dff(t) = m - /(a), ,CfA“/(() = /(a) - /(!>)• 


Theorem 2.2. Fractional integration by parts. 

70 Let 0 < a < 1, /(•) be a differentiable function in interval [a, b] and 
g(-) € Li([a, &]). Then the following integration by parts formula holds 

[ = f f(t),D; g (t)dt + 

J a J a 

and 

( g(t)?DZf(t)dt = ! f{t) a D*g(t)dt - [ a il~ a g(t)f(t)] b a . 

J a J a 


Another important auxiliary result to prove our Maximum Principle is 
the generalization of the Bellman-Gronwall Lemma for fractional differen¬ 
tial systems. Here, we will consider the following integral from extracted 
75 from [13] • 
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Theorem 2.3. Generalized Bellman-Gronwall inequality. 

Suppose a > 0, t G [0, T) and the functions a(t), b(t) and u{t) are a 
non-negative and continuous functions on 0 < t < T with 

u(t) < a(t ) + bit) f (t — s) a ~ 1 u(s)ds , 

Jo 

where b{t) is a bounded and monotonic increasing function on [0, T), then 


u(t) < a(t ) + 



£ 


m£H) 

r (na) 


(t - s) na ~ 1 a(s) 


ds, 


te[o,T) 


Theorem 2.4. Generalized Taylor’s formula (cf. E Hi- 
Let 0<a<l,nGN, /(•) be a continuous function in [a,b\, c D^ a f{-) G 
C[a, b] Vk — 1,..., n and c D% l+1 '* a f (•) is continuous on [a, b], then \/x G [a, b] 
so the generalized Taylor’s formula for Caputo fractional derivatives is defined 
by 


f ( x ) = 

k =0 


(x — a) kot 
T(ka + 1) 


c D k a a f(a) + R n (x,a), 


where 


Rn(x,a) 


= C B<” + D “/(0 


(x - a) (n+1) « 
r((n + l)a + 1) 


being, for each x G [a,b], a < £ < x, and denoting the Caputo fractional 
derivative of order a by C T ) “. 

Notice that, if a = 1, the generalized Taylor’s formula reduces to the classical 
85 Taylor’s formula. 

Lemma 2.1. (see 0 ) Let / G C[a,b], a > 0, then there exists some 
£ G (a, b) such that 


IJ + f(x) = -^-[ [x-t) a 1 f(t)dt = /(£) [f ^ , 

r(a) Ja r{l + a) 

where £ the fractional intermediate value. Remark that there might exist 
more than one £ satisfying this property. 
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Definition 2.4. The two-parameter Mittag-Leffler function defined by the 
power series in the form: 


E a A z ) = 


p r [na + PY 


n =0 


% where a , and (3 are positive parameters. When /3 = 1, this function is denoted 
simply by E a (-). We observe that E 0 pz) = 1/(1 — z ), E\\ (z) = exp£, 
E\A Z ) = (expz — 1 )/z, and Ei 0 (z) = zexpz. 

Let A G M nxn , then the generalization of the two-parameter Mittag- 
Leffler function becomes 


E a ,p(At a ) = ^ A n 

n =0 


t na 

r['no + j3\ ’ 


and let us define the a exponential matrix function by using Mittag-Leffler 
function as follows 


e a (A,t) = t a ~ l E a)0l (At a ) = t a ~ lS ^A r ' 


n =0 


r[(n + l)a] 


( 1 ) 


95 The Mi ttag -Leffler function has several interesting properties. For details see 


18|, ll9|, |20|, l2lj 


3. The FOCP statement and its Maximum Principle 

In this section, we discuss the FOCP considered in this article, state the 
associated necessary conditions of optimality, and present its proof which 
ioo uses an approach that differs from the ones usually adopted for fractional 
optimal control problems. 

Let us consider the simple general problem as follows 

(P) Minimize x{t ), u[t)) 

subject to t Q Dtx(t) = f(t,x(t),u(t)), [to,tf] £ — a.e. ( 2 ) 
x(t 0 ) = xq G M n (3) 

u{t) G U (4) 

where U = {u : [to,tf] : u if) £ O(t)}, ^ ; [0 Af] —>■ is a given 

set valued mapping, L : M n —>■ M and / : [to,tf] X M n x M m —> M n are given 
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105 functions defining respectively the running cost (or Lagrangian) functional 
and the fractional dynamics, to is the Riemann-Liouville fractional integral 
and %D tX is the left Caputo fractional derivative of order a > 0 of the state 
variable with respect to time. 

It is not hard to see that a simple transformation allows us to convert 
no the problem (P) into an equivalent one, simply by using this assumption 


pDfyit) = L(t,x(t),u(t)), supplemented by the initial condition y(t 0 ) = 0. 
Then, we conclude that problem (P) is equivalent to the one as follows: 

(P) Minimize g(x(tf)) 

subject to f o D^x(t) = f(t, x(t), u(t)), [to, tf] C — a.e. (5) 
x(t 0 ) = xq £ M n ( 6 ) 

u(t) £ U , (7) 


where now g(x(tf )) = y(tf), the state variable x = col(y,x), i.e., it includes 
y as a first component with initial value at 0, and the mapping / = col(L, /), 
ns i.e., it has L as first component. 

From now on, we consider this as the basic optimal control problem in 
normal form. We remark that the above problem statement is the simplest 
one that can be considered containing all the ingredients required for “bona 
fide” optimal control problem. 

120 Now, we will state the assumptions under which our result will be proved. 

(HI) The function g is C\ in M n , i.e., continuously differentiable in its do¬ 
main. 

(H2) The function / is C\ and Lipschitz continuous with constant Kf in x 
for all (t,u) £ {(f,h 2 (f)) : t £ [to,tf]}. 

125 (H3) The function / is continuous in ( t,u ), for all x £ M n . 

(H4) The set valued map f 1 : {to, tf] —$■ M m is compact valued. 

(H5) The set f(t,x,£}(t)) is bounded by a certain positive constant M for 
all (f, x) £ [to,tf\ x M n . 

These are, by no means, the weakest hypotheses enabling the proof of the 
no maximum principles for FOCPs. However, these ones are of interest in that 
it allows the particularly simple proof adopted in this article. 
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Consider 


H(t, x,p, u) := p T f (t, x, u), 

with p G R n , to be the Pontryagin function associated to problem (P). 

Theorem 3.1 Let (x*,u*) be optimal control process for (P). Then, there 
exists a function p : [t 0 ,t/] —>• R n satisfying 

• the adjoint equation 

t D? f p T (t) = p T (t)D x f(t , x*(t), u*(t)), (8) 

• and the transversality condition 

P T (tf) = V x g(x*(t f )), (9) 

where the operator t D° f is right Riemann-Liouville fractional derivative, and 
u* : [to, tf] —> R m is a control strategy such that u*(t) maximizes [to, tf] C- a.e. 
the map 

u —> H (t, x* (t), p(t), u ), 

135 on O(t). 

Proof of Theorem 3.1 

The first key idea is that any perturbation of the optimal control u* 
that affects the final value of the state trajectory may increase the cost. 
Thus, the proof relies on the comparison between the optimal trajectory x* 
wo and trajectories x which are obtained by perturbing the optimal control u*. 
Let t be a Lebesgue point in ( t 0 ,tf ), and £ > 0 sufficiently small so that 
t — £ > to. By Lebesgue point in the fractional context, which define in the 
next definition. 

Definition 3.1. A Lebesgue point of an integrable function / : M —y M is a 
M 5 point to ^ R satisfying 

lim + to-elto+e I/O) - /(to)| -> 0. 

e—>-C p Zc 

It is well known that the subset of Lebesgue points of an integrable function 
/ forms a full Lebesgue measure subset. 
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Now, let us consider the perturbed control strategy u Tj£ defined by 


J u if t E [r — £,r) 

\ U*(t) if t e [to, t,] \ [t - £, t) 


(10) 


where u E 0(f) for all t E [r — e,r), being r a Lebesgue point of the reference 
150 optimal control strategy. Note that, there is no loss of generality of the choice 
of r due to the fact that the set Lebesgue points is of full Lebesgue measure. 

Let x Tj£ be the trajectory associated with u Tj£ , and with x T , £ (to) = xq. 
Clearly, by definition of optimality of ( x*,u *), 


r 0 < g(x T , £ (t f )) - g(x*(t f )) 

| = V x g(x*(t f ))[x T:£ (tf) -x*{t f )] +o(e) (11) 

1 = \7 x g(x*(t f ))$ a (t f ,T)[x T:£ (T) - x*(r)}+o(s), 


where V x g(-) is the gradient of g(-), o(e) is some positive number satisfying 
) is the state transition matrix for the linear fractional 


lim = 0 , $ c 


£->0 £ 
differential system 


= D xf(t,x*(t),u*(t))£(t), 

and x T)£ : [t 0 ,f/] —> R n is the solution to ^D^x T)£ {t) = f(t,x Tt£ (t),u Tj£ (t)) 
155 with x Tj£ ( 0 ) = x 0 . 

Observe that x Tt£ (t) = x*(t), for all t E [t 0 ,T). 

For all t E [r — £,r), it is clear that 


%T,£ (t) 


X*(t )I < T- e I?\f(s,x Tte (s),u) - f(s,x*(s),u*(s))\ds 
< r-J?K,\x Tf (s) ~ x'(s)\ds + 2 M E ° 

1 (tt + 1 j 

Me a 

- r(a + l)’ 


where 


M = 2 M (l - K, V l)'' 1 '" ' 

( ^Una+l) ) 


It is not difficult to show that this series converges and thus M is some finite 
positive number. The last inequality was obtained by applying Theorem 2.3. 
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160 In order to proceed, we need the following auxiliary result. 

Lemma 3.1. Consider the general time interval [a, b] and define the function 
F(t,x) = f(t,x,u), where u is like in (fT0lh Moreover, consider x(-) and y(-) 
to be, respectively, solutions to the following fractional differential systems: 

• ° a D tx[t) = F(t,x(t)) with x(a) = x a , and 

i65 • c a D?y(t) = D x F(t,x(t))y(t) with y(a) = yT(a + 1). 

Then, for all v positive and sufficiently small real number, we have that #„(•) 
solution to the system 

°Dfx v (t) = F[t , x u (t)), x„(a) ex a + u a y + o(v a )B™ ( 0 ), 

satishes on [a, b ], 

x v {t) G x(t) + + o{v a )B^{ 0). 

f (a + 1) 

Here, B™( 0) denotes the closed unit ball of IRC centered at 0, 

Proof of Lemma 3.1 

After using Taylor’s series of fractional order as defined in Theorem 2.4. We 
conclude next inequality 


c D a 

a^t 


x(t) + 


T(o + 1) 


y{t) - F(t,x(t ) + 


T(a + 1) 


y(t)) 


< o(v°) 


and we can be extracted this inequality as the follows 


+“D?y(t) 


c 




T(a + 1) 


~F(t,x(t)) - 


T(o + 1) 


D x F(t,x{t))y{t )) 


< o{v a )- 


Clearly, the first and the third terms cancel each other in the left hand side 
of the inequality, and, thus, we have 


c Dfy(t) 




i/ 


T(a + 1) T(a + 1) 


D x F(t,x(t))y{t )) 


< o(i/ a ) ■ 


By dividing each side by u a , where —> 0, when v —> 0 + , we conclude 

immediately fractional linearized differential system 
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□ 


a D ?y(t) = D x F(t , x(t))y(t), y(a ) = yT(a + 1 ). 

_ £ a - 

170 Since, from above, |x TE (r) — x*(t) I < M— -- for some finite M, we 

I (a + 1) 

may apply Lemma 3.1 to the case of £ 6 [r, tf\. 

By putting a = r, x = x*, y = £, v = e, x = x Tt£ and 

V = f( r , x T)£ (t), u) - /(r, x*(t),u*(t)), 

Lemma 3.2 readily yields, for almost all t 6 [r, tf], 

XrAt) e z*(f) + r , £ , + o(e“) 5 "(0), (12) 

i (a + 1) 

where £(•) satishes the fractional linearized differential system 


£(t) = D x f{t,x*(t),u*{t))£(t), C — a.e. t G [r,£/], 
fCO = /(b^t, £ (t),m) - /(t,x*(t),w*(t)). 


(13) 


By putting together (1121) , and the chain of inequalities in (1111) we can imme¬ 
diately write the inequality 


0 < S7 x g(x*(tf))§ a (t fl T){x T}£ {T) - x*(t)\+o(e) 

< r / g + 1} V x g(x*(t f ))$ a (t f ,T)t(T). (14) 

175 By putting p T (tf ) = —V x g(x*(tf)) and p T (t) = p T t), we conclude 
immediately that the adjoint variable p : [£ 0 ,£/] —> satisfies the adjoint 

equation and the transversatility condition, respectively, (JHJ) and (J9|. 

This, together with the definition of £(r) and the dehnition of the Pontryagin 
function, we conclude, after dividing both sides of the inequality above by 
e a 

—---, considering the arbitrariness of u G 0 (t) and taking the limit as 

r(a + 1) 

£ —y 0 ”*~ at time r, that 

H(r, x*(t),p(t),u*(t)) > H(t,x*(t),p(t),u). 

The fact that r is an arbitrary Lebesgue point in [£q,£/] implies that the 
maximum condition of our main result holds, that is, u*(t) maximizes, on 
iso 0(t), the map u —> H(t,x*(t),p(t),u), [£ 0 ,£/] £-a.e.. 

Our main result is proved. 
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4. Illustrative example 

The Pontryagin maximum principle proved in the previous section is now 
apply to solve a simple problem of resources management that involves min- 
i85 imizing a certain fractional integral subject to given controlled FDEs. 

We consider the following problem 


Minimize J(w) (15) 

subject to QDfX(t) — u(t)x(t), t 6 [0,T], (16) 

x(0) = x 0 , (17) 

u{t)e [0,1], (18) 


where J(u) = — 0 1^(1 — u{t))x{t), with 0 < a < 1 and T > T(a + 1)“ \ Here 
qIj, is fractional integral and q 'D£ is left Caputo fractional derivative. 

The variable x represents a natural resource that takes positive values (note 
190 that Xq > 0 necessarily) “grows” according to the law dT 6 j) , where the function 
u, designated by control, represents the fraction of the available resource that 
is used to promote further growth. The overall goal is to find the control 
strategy that maximizes the amount of accumulated resource over the time 
interval [0, T] given by the fractional integral (fl5jl . 

First, we consider an additional state variable component y, satisfying 

oD?y{t) = (1 - u(t))x(t), 2 /( 0 ) = 0, 

195 in order obtain the problem statement in the form considered in our main 
result, that is, 

Minimize ~y(T) 

subject to o D ?x(t) = u(t)x(t), x(0) = xq, 

o D ?y (t) = (1 - u(t))x(t), 2 /( 0 ) = 0, 

u{t) e [0,1]. 

From Theorem 3.1, the adjoint equation (jSJ) and the transversality condi¬ 
tion ([ 2 ]) for this problem are 

tDrpP\{t) = \piu*{t) +p 2 (l -u*(t))\, Pi(T) = 0, (19) 

t D%p2{t) = 0, p 2 (T) = 1 (20) 
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where t Dj< is right Ricmann-Liouvillc fractional derivative of order a. Thus, 
we have that p 2 (^) = P 2 (T) = 1, and equation (fTUl) becomes 


t DZp 1 (t) = [(p 1 (t)-l)u*(t) + l]. (21) 

From the maximum condition, we know that u*(t) maximizes, C- a.e. in [0,1], 
the mapping 

v p T (t)f(t,x*(t),y*(t),v) = [pi(t)u+p 2 (t)(l -v)}x*(t). 


Since p 2 = 1 and x*(t) > 0 for all t G [0, T] (this is to conclude from 
200 the fact that xq > 0), the mapping to be maximized can be simplified to 
v —> (p\ (t) — l)u. Thus, given that the system is time invariant, we have that 


f 1 if Pi(t) > 

\ 0 if pi(t) < 1 


Since p\ (T) = 0, and pi(-) is continuous, 3b > 0 s.t. u*(t) = 0 Vt G [T — b,T], 
Thus, from (TT9l) we have t D^pi{t) = 1 and, by backwards integration we 
obtain 


Pi{t) 


(T — t) a 
T(a + 1) 


( 22 ) 


Obviously that, for t* = T — (T(a + 1))«, we obtain pi(t*) = 1. Now, Let us 
determine the optimal control for t < t*. Since, independently of the control 
Pi(-) remains monotonically decreasing, we have for t < t*, u*(t) — 1 , and, 
thus, 

tD^Piit) = pi(t) (23) 


The solution of this linear fractional differential equation (I25|) is given by 
p(t) = p(t*)$ a (t*,t), where p(t*) = 1 and $ Q (t*,t) is the fractional state 
transition matrix (in fact, scalar-valued) that can be computed by the Mittag- 
205 Leffler function defined in the previous section. By setting f3 = a, A = [1] 
and by replacing t by t* — t = T — T(a + 1)" — t, we conclude that 


Pi(t) = e Q (l ,t*-t) 

= (t* -t) a ) 

(t* - t) ka 


(i * _ ty- 1 £ 


-r((*+ !)<*) 


Note that if a — 1, then we have classical solution e 


T-t-l 
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Since we have the optimal control u *, we can easily compute the optimal 
trajectory which satisfies x*(0) = x 0 , and 


c 


D“x’(t) 


x*(t ) if t £ [0, t*] 
0 if te[t*,T] 


210 We can compute the optimal trajectory x* by the generalization Mittag- 
Leffler function, Vf G [0, t*], rr*(0) = x 0 , we conclude that 


x*(t ) = E a (a,t a ) 
= x 0 E a (t a ) 


= xo 


E 

k =0 


ika 


Y{ka + 1) 


Note that if a = 1, then we have classical solution x^e 1 . 

Now we compute the optimal trajectory x* in the interval [t*,T], which 
u* = 0, x*(t) = x*(T), we conclude that 


x*(t) = x*{t*) 

= x 0 E a ((t *) a ) 

A (T- {T(a + l))^) ka 

- r(kct + 1 ) ' 

215 Note that if a = 1, then we have classical solution x^e 1 ^ 1 


5. Conclusion 

This article concerns the derivation of necessary conditions of optimality 
in the form of Pontryagin maximum principle for a nonlinear fractional opti¬ 
mal control problem whose differential equation involves the Caputo deriva- 
220 tive of the state variable with respect to time. Under mild assumptions on 
the data of the problem the proof involved the direct application of varia¬ 
tional arguments, thus avoiding the often used argument of converting the 
optimal control problem into a conventional one and, then, express the opti¬ 
mality conditions for this auxiliary problem back in the fractional derivative 
225 context. Another interesting novelty consists in the fact that, unlike in most 
fractional optimal control problem formulations, we consider the cost func¬ 
tional given by a fractional integral of Riemann-Liouville type. 


14 



A simple example illustrating the application of onr maximum principle 
was presented. The optimal control strategy was computed analytically being 
230 the fractional differential adjoint equation solved by using technique based 
on a generalization Mittag-Leffler function. 

A natural sequel of this article concerns the weakening of the assumptions 
on the data of the problem, notably the mere measurability dependence of 
the dynamics with respect to time and to the control variables. This will 
235 certainly require more sophisticated variational arguments and the use of 
methods and results of nonsmooth analysis. Another direction of research 
consists in increasing the structure of the fractional optimal control problem 
by considering additional state endpoint constraints, and state and/or mixed 
constraints in its formulation. In this case, additional regularity assumptions 
240 will be needed to ensure that the obtained necessary conditions of optimality 
do not degenerate. 
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